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MULTI-AGENT AUTONOMOUS SYSTEM 
AND METHOD 

CROSS-REFERENCE TO RELATED 

APPLICATIONS 5 

This application is a continuation in part of U.S. applica- 
tion Ser. No. 11/261,549, filed on Oct. 28, 2005, which is a 
division of U.S. application Ser. No. 10/625,834, filed Jul. 22, 
2003, now U.S. Pat. No. 6,990,406, which claims the benefit to 
of U.S. Provisional Patent Application No. 60/398,052, filed 
Jul. 22, 2002 and U.S. Provisional Patent Application No. 
60/473,726, filed May 28, 2003, each of which are hereby 
incorporated by reference as if fully stated herein. 

15 

STATEMENT REGARDING FEDERALLY 
SPONSORED RESEARCH OR DEVELOPMENT 

The invention described herein was made in the perfor- 
mance of work under a NASA contract, and is subject to the 20 
provisions of Public Law 96-517 (35 U.S.C. 202) in which the 
contractor has elected to retain title. 

BACKGROUND OF THE INVENTION 

25 

Robotic reconnaissance operations are called for in poten- 
tially hazardous and/or inaccessible situations such as explo- 
ration of remote planetary surfaces, military operations, 
cleanup, mining, rescue operations, oil drilling, and natural 
terrain or resource exploration. One approach to such opera- 30 
tions is to use a few sophisticated, expensive, highly capable 
and reasoning surface-based reconnaissance crafts (e.g., rov- 
ers). In this case the reconnaissance mission is lost or 
adversely affected when one of the few robotic reconnais- 
sance crafts is damaged or destroyed because there is no 35 
redundancy. 

In addition, rovers are spatially constrained in that they 
may only view a small portion of an explored area at a time, 
they are limited to traversing certain terrains, and they have 
limited lifetime expectancy in extreme conditions. For 40 
example, as most rovers are tracked or wheeled surface-based 
craft, their elevation above the ground provides only a limited 
viewing range, and they cannot traverse over topographic 
highs such as sheer slopes of prominent mountains, canyon 
walls, cliffs, and topographic lows surrounded by near verti- 45 
cal slopes. Therefore, it is difficult for a rover to view a large 
enough area to make an intelligent decision about what fea- 
tures in an operational area are worthy of additional investi- 
gation, or the rover is constrained to certain terrains that may 
have limited return of information of special interest, e.g., 50 
scientific, industrial, military, rescue, etc. 

The spatial constraint of a rover also causes difficulties 
when planning a path for the rover to follow when traveling 
through the operational area. As such, the rover may construct 
a locally optimal path through an operational area but not a 55 
globally optimal path because the rover may not be able to 
view a large enough area. Therefore, the rover may not be able 
to perform optimal reconnaissance of the features, areas, 
characteristics, or anomalies of interest. 

As an intelligent rover is expensive, both from the perspec- 60 
five of the capital cost to build and the resource cost to deploy 
and operate, only a single rover is typically deployed within 
an operational area. This means that any operational area is 
constrained to an area no larger than what a single rover can 
explore. 65 

Finally, because the loss of a single rover during an explo- 
ration mission may be catastrophic from the perspective of 
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accomplishing the mission goals, there has been reluctance 
within the robotics community to allow a rover to be truly 
autonomous . True autonomy means that a rover would be able 
to make its own decisions about where to go within an explo- 
ration space. If the logic controlling the operations of the 
rover is faulty, and the rover makes a decision that causes it to 
become inoperable, the mission may be lost. As such, most 
currently deployed rovers are not truly autonomous as they 
are at least partially controlled by teleoperation by a human, 
and thus they conduct point to point reconnaissance rather 
than investigating and formulating hypotheses while en route, 
likely missing invaluable information along the constrained 
path. 

Therefore, a need exists for a robotic reconnaissance sys- 
tem that uses various crafts and sensors that are inexpensive 
enough, both in terms of capital cost and operational 
resources, so that multiple crafts and sensors can be deployed 
during a mission. Multiple crafts and sensors provide redun- 
dancy in the event a craft or sensor is lost. In addition, mul- 
tiple crafts and sensors may explore a larger area than a single 
craft. Finally, as loss of one or more of the multiple crafts or 
sensors will not destroy a mission, the robotic reconnaissance 
system may be allowed more autonomy in making decisions 
about what paths to take while exploring an area. 

Algorithms for determining paths for a robot in an accu- 
rately characterized environment are well known in the robot- 
ics industry. Using these conventional means, the issue of 
simultaneously commanding and moving even a few 
deployed reconnaissance agents to their designated destina- 
tions becomes exceedingly complex. Each additional simul- 
taneously moving agent increases geometrically the chances 
of collisions as well as the processing power required for 
computing and managing the agent trajectories. 

Additional complications arise when the operational area 
in which the agents (e.g., crafts) are moving is not accurately 
characterized. Even slight errors in slope, mapping, positions 
and orientation of the agents, or changes in the terrain may 
result in the agent reaching an entirely different destination 
than intended. As agents may be moving simultaneously, 
these changes may also result in collisions that may damage 
or destroy expensive equipment and lose valuable data col- 
lections. 

SUMMARY OF THE INVENTION 

A method of controlling a plurality of crafts in an opera- 
tional area includes providing a command system, a first craft 
in the operational area and coupled to the command system, 
and a second craft in the operational area and coupled to the 
command system. The method also includes determining a 
first desired destination and a first trajectory to the first 
desired destination, sending a first command from the com- 
mand system to the first craft to move a first distance along the 
first trajectory, and moving the first craft according to the first 
command. 

A second desired destination and a second trajectory to the 
second desired destination are determined, and a second com- 
mand is sent from the command system to the second craft to 
move a second distance along the second trajectory. 

In one embodiment, a location of the first craft is deter- 
mined after moving the first craft according to the first com- 
mand. 

In one embodiment, the second craft is moved according to 
the second command. In one embodiment, the second com- 
mand is sent after moving the first craft according to the first 
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command. The method may also include determining a loca- 
tion of the second craft after moving the second craft accord- 
ing to the second command. 

The first distance may be shorter than a distance of the first 
trajectory to the first desired destination. The second distance 
may be shorter than a distance of the second trajectory to the 
second desired destination. 

The first desired destination may be the same as or different 
from the second desired destination. The command system 
may be in or outside of the operational area. 

In one embodiment, the first craft is at least one of ground- 
based, subsurface-based, airborne, spacebome, or water- 
borne. 

One embodiment of the method also includes providing a 
third craft in the operational area and coupled to the first craft, 
the second craft, or both. A third desired destination and a 
third trajectory to the third desired destination are determined 
and a third command can be sent from the first craft, the 
second craft, or both to the third craft to move a third distance 
along the third trajectory. The third craft is then moved 
according to the third command. 

In several embodiments, a third trajectory is determined. 
The third trajectory may be the same as the first trajectory or 
different. The determining of the third trajectory may be 
based on the determined location of the first craft, another 
desired destination, detection of a characteristic, or an 
anomaly. The detection of the characteristic may be by the 
crafts or the command system, and may be spatial or tempo- 
ral. Examples of spatial characteristics are location of the 
crafts, features of the operational area, features of an object in 
the operational areas, movement, etc. Examples of temporal 
characteristics are a duration of movement or a particular, 
predetermined time for recalculation. .An anomaly is deter- 
mined by comparison of data sensed by the crafts or com- 
mand system with a stored dataset. Examples of an anomaly 
are an object unique to the operational area or a transient 
event. 

The first craft can then be commanded to move a third 
distance along the third trajectory. 

One embodiment includes sensing of the operational area 
by the first craft to obtain sensing information and transmit- 
ting the sensing information to the command system. A third 
trajectory for the first craft can also be determined by the 
command system at least in part based on the sensing infor- 
mation. A third command can then be sent to the first craft to 
move a third distance along the third trajectory. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other features, aspects, and advantages of the 
present invention will become better understood with regard 
to the following description, appended claims, and accompa- 
nying drawings where: 

FIG. la is a block diagram of a multi-agent autonomous 
system in accordance with an exemplary embodiment of the 
present invention; 

FIG. lb is a block diagram illustrating the use of a multi- 
agent autonomous system to explore an operational area in 
accordance with an exemplary embodiment of the present 
invention; 

FIG. 2 is a block diagram illustrating communication links 
within a multi-agent autonomous system in accordance with 
an exemplary embodiment of the present invention; 

FIG. 3 is a block diagram of an agent or craft in accordance 
with an exemplary embodiment of the present invention; 
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FIG. 4 is a block diagram of a craft tracking and command 
system in accordance with an exemplary embodiment of the 
present invention; 

FIG. 5 is a software module diagram of a multi-agent 
5 autonomous system in accordance with an exemplary 
embodiment of the present invention; 

FIG. 6 is a process flow diagram for a multi-agent autono- 
mous system in accordance with an exemplary embodiment 
of the present invention; 

10 FIG. la is a block diagram of a craft imaged in an environ- 
ment by a craft tracking and command system in accordance 
with an exemplary embodiment of the present invention; 

FIG. lb is a block diagram of a craft, targets, and obstacles 
identified in an environment by a craft tracking and command 
15 system in accordance with an exemplary embodiment of the 
present invention; 

FIG. 1c is a block diagram of a planned craft path in 
accordance with an exemplary embodiment of the present 
invention; 

20 FIG. 8 is a block diagram depicting an iterative path plan- 
ning sequence in accordance with an exemplary embodiment 
of the present invention; 

FIG. 9 is a process flow diagram of an image processing 
system in accordance with an exemplary embodiment of the 
25 present invention; 

FIG. 10 is a process flow diagram of a craft command 
process in accordance with an exemplary embodiment of the 
present invention; 

FIG. 11 is an architecture diagram of a data processing 
30 apparatus suitable for use as a craft tracking and command 
system in accordance with an exemplary embodiment of the 
present invention; 

FIGS. 12a-12q are perspective views showing stages in 
one embodiment of a craft command process according to the 
35 present invention; and 

FIG. 13 is a process flow diagram of a method of control- 
ling a plurality of crafts according to one embodiment of the 
present invention. 

40 DETAILED DESCRIPTION 

A multi-agent autonomous system includes numerous and 
redundant, specialized, low cost, expendable, sensor- 
equipped, self-propelled reconnaissance crafts, landers, and/ 
45 or immobile agents (e.g., sensors of diverse types, sizes, and 
shapes), that collectively can perform tier- scalable reconnais- 
sance of vast expanses of terrain in a relatively short amount 
of time. Furthermore, in utilizing an overhead view, several 
significant mission advantages emerge, such as: enhanced 
50 craft safety (e.g. , cliffs are visible long before the rover arrives 
there); more efficient air-controlled path planning for crafts, 
thus increased mission science return; and enhanced control 
of craft traverses in unknown terrain. 

Integrated multi-tiered, multi-agent autonomous remote 
55 planetary surface and subsurface exploration allows truly 
autonomous science exploration missions with, for example, 
air and ground-based agents in real environments. Further- 
more, an overhead perspective allows for unprecedented 
safety of surface-based craft, i.e., non-traversable terrain 
60 (e.g., cliffs) is detected long before a surface-based craft 
arrives there. Also, the overhead view allows for much more 
efficient path planning and location tracking of the ground- 
based craft simply because more terrain is visible. This is 
particularly important when a surface-based craft leaves an 
65 operational area that was imaged during a descent onto a 
planetary surface or operates in rugged terrain where field of 
view is restricted. Optimized path planning leads to increased 
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mission objective return. The advantage of having an over- 
head view reduces drastically the planning effort necessary to 
navigate the surface-based craft and thus allows for com- 
manding multiple surface-based crafts with almost no addi- 
tional effort, as well as deployment of surface-based crafts 
and immobile crafts (e.g., sensors, drill rigs, etc.) to identified 
targets of interest. 

Although embodiments of the invention will be discussed 
mainly in the context of surface-based crafts, it is also within 
the scope of the invention for the crafts to be subsurface- 
based, airborne, spacebome, waterborne, or any combination 
of these. For example, the crafts may be airborne in any type 
of atmosphere, may be dropped onto the ground surface, and 
maneuver toward a body of water, to float on its surface or 
submerge below its surface to explore its depths or to move on 
the floor of the body of water (e.g., ocean floor). In another 
embodiment, they could drop onto the ground surface and 
drill into the subsurface to explore its depths (e.g., ice or soil 
drilling). 

The multi-agent autonomous system can be applied to a 
variety of missions, such as: mine-sweeping operations; 
clean-up operations in hazardous environments (e.g., chemi- 
cal plants, nuclear plants, etc.); scientific operations such as 
sample detection and sample return (e.g., search for meteor- 
ites in Antarctica or exploration of a volcano, exotic mineral, 
and/or life on Earth and beyond); military reconnaissance 
operations in hostile environments; rescue operations in 
catastrophe-impacted areas; and industrial mining or oil drill- 
ing operations. 

FIG. la is a block diagram of a multi-agent autonomous 
system in accordance with an exemplary embodiment of the 
present invention. A multi-agent autonomous system 
includes an airborne tracking and command system 100a that 
may be held aloft by a support platform such as a lighter-than- 
air aircraft or balloon 101a. The tracking and command sys- 
tem is in communication with one or more surface-based craft 
or agents, such as craft 102a and 104a, as well as immobile 
landers, drill rigs, or sensors such as 109a. Communications 
may be accomplished by radio control communications links 
103a and 105a. 

Each craft or lander includes an instrument suite, such as 
instrument suites 108a and 110a that are used by the craft to 
obtain information about an environment or operational area 
in which the crafts are deployed. For example, the instrument 
suite may include an optical camera for taking images of an 
area immediately around each of the crafts. Other imaging 
systems and instruments may be employed as well. For 
example, the crafts may include sensors for detecting a wide 
variety of data, such as geochemical, geophysical, strati- 
graphic, tectonic, spectral, elemental, geomorphic, ped- 
ologic, biologic, hydrologic, geologic, topographic, climato- 
logic, seismic, and acoustical information. Sensors may, for 
example, detect pressure, temperature (thermal), atmospheric 
conditions, subsurface information, radioactivity, the pres- 
ence of moisture or water, etc. 

The sensor signals containing sensing information from 
the instrument suite are transmitted by the craft or lander to 
the tracking and command system. 

The tracking and command system includes its own instru- 
ment suite 112a. The tracking and command system uses its 
instrument suite to take sensor readings of the craft and the 
environment surrounding the craft. For example, the tracking 
and command system’s instrument suite may include an 
operational area imager such as an optical camera for captur- 
ing images of the craft environment and the craft within the 
environment. The tracking and command system may also 
include any other type of sensor, as described above. 
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In operation, the tracking and command system receives 
signals from its instrument suite including environment and 
craft signals indicating the position and heading of each craft 
in the environment. The tracking and command system uses 
5 the signals to generate a set of craft movement commands that 
are transmitted to the craft. The crafts respond to the craft 
movement command signals by moving in the commanded 
manner through the environment. The tracking and command 
system also generates craft command signals commanding 
to the crafts to employ their own instrument suites to investigate 
objects or targets within their environment. 

As the tracking and command system in this embodiment 
is airborne above the craft environment, the tracking and 
command system has a much larger field of view than the 
15 craft. As such, the tracking and command system may detect 
various obstacles and targets, characteristics, or anomalies in 
the environment that the surface-based craft may not be able 
to detect. By having a larger field of view of the environment, 
the tracking and command system may select targets for 
20 exploration by the crafts that the surface-based crafts are 
unable to select simply because the surface-based crafts can- 
not detect the potential target in the first place. In addition, the 
tracking and command system may use its larger field of view 
to more accurately determine a path for each craft around 
25 obstacles in the craft’s environment. 

As discussed above, the tracking and command system 
may alternatively be spacebome, waterborne, ground-based, 
or subsurface. For example, a spacebome command system, 
such as an orbiting space craft has a global view, improving 
30 the detection of transient events, such as the release of a 
plume of methane, volcanic eruption, seep of water, deploy- 
ment of troops, etc. Spacecraft can also continuously observe 
a locale/target. Similarly, a waterborne command system, 
such as a ship, can view the subsurface body of water and 
35 direct submarines and ocean floor rovers. 

The broader field of view of the tracking and command 
system is not limited to an overhead view, but may be an 
upward, sideways, or any other orientation having a greater 
field of view than the crafts. For example, the tracking and 
40 command center could be on the ground looking up to navi- 
gate and control several airships or planes, or shoot down 
missiles with a ground-based laser. A sideways scenario 
could be the deployment of troops and tanks in a battle field 
where everything, including the tracking and command cen- 
45 ter are ground-based in one plane. 

Referring again to FIG. la, the aircraft supporting the 
tracking and command system may further include a thrust 
generating element 114a for maneuvering the aircraft. 
Maneuvering the aircraft may be useful for both ensuring the 
50 aircraft remains in a desired area or for moving the multi - 
agent autonomous system to a new operational area. In addi- 
tion, various forms of aircraft may be used as a platform for 
the tracking and command system. For example, the aircraft 
may be some other type of lighter-than-air aircraft such as a 
55 blimp. The aircraft may also be a heavier-than-air aircraft 
such as a glider, airplane, or helicopter. 

In another tracking and command system support platform 
in accordance with an exemplary embodiment of the present 
invention, the platform is a tethered lighter-than-air aircraft. 
60 The aircraft may be tethered either directly to the surface, and 
thus fixed in place, or may be tethered to one of the surface- 
based craft. If tethered to one of the surface-based craft, the 
support platform and tracking and command system may 
travel to different locations along with the surface-based 
65 craft. 

In another embodiment, the deployed agents may include 
one or more non-mobile sensors or landers, such as sensor 
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109a, that are not self-propelled. These additional sensors 
may be used to augment or replace the surface-based infor- 
mation collected by the mobile surface-based craft. 

FIG. lb is a block diagram illustrating the use of a multi- 
agent autonomous system to explore an area in accordance 
with an exemplary embodiment of the present invention. One 
or more multi-agent autonomous systems, such as multi- 
agent autonomous systems 116a and 1 1 6b, may be coupled to 
a satellite 118 for exploration of a large area. The satellite may 
include its own instrument suite 119 for imaging the area 
being explored by the multi -agent autonomous systems. 
Information collected by the multi-agent autonomous sys- 
tems and the satellite using its instrument suite is integrated 
120 to generate a database (Multi-Layer Information System 
(MLIS)) 122 including views of the explored area generated 
by the various components of the exploration system. For 
example, information supplied by the surface-based craft 124 
may include the detailed images of an operational area. How- 
ever, since the surface-based craft have only a limited view, 
the actual area imaged by the surface-based craft may be 
small. 

Information supplied by the airborne tracking and com- 
mand systems 126 may include images of a large portion of 
the explored area. However, as the airborne tracking and 
command systems are more elevated and further away from 
the explored area with respect to the surface-based craft, the 
information supplied by the tracking and command systems 
may be less detailed than the information collected by the 
surface-based craft. Information supplied by the satellite may 
include images from the entire explored area, but may not be 
as detailed as the information supplied by the tracking and 
command systems. By combining information from the com- 
ponents of the exploration system, a large area may be 
explored with a high level of detail. 

Portions of the database of information may be transmitted 
130 to the satellite and distributed to the coupled multi -agent 
autonomous systems. In this way, a multi-agent autonomous 
system may use information collected by the satellite or 
another autonomous system to aid in selection of targets to be 
explored by the surface-based crafts. 

FIG. 2 is a block diagram illustrating connnunication links 
within an exploration system using a multi-agent autonomous 
system in accordance with an exemplary embodiment of the 
present invention. A tracking and command system 100a 
receives an initiation signal 200 from a satellite 118. The 
tracking and command system may also receive information 
201 about an area to be explored, such as images generated by 
the satellite’s instrument suite 119. In response to the initia- 
tion signal, the tracking and command system uses its own 
instrument suite 112a to image the area to be explored. The 
tracking and command system uses the information received 
from the satellite and its own imaging information to identify 
targets and obstacles in the area to be explored. Once the 
targets and the objects have been identified, the tracking and 
command system generates a path or trajectory for a craft 
104a to follow to get from the craft’s current position to a 
target while avoiding any obstacles. The tracking and com- 
mand system uses the path to generate and transmit craft 
command signals 202 to the craft. The craft responds to the 
command signals until it reaches a target. At the target, the 
craft uses its own instrument suite 110a to collect surface- 
based information about the target. The craft transmits the 
information about the target 204 to the tracking and command 
system or directly to the spacebome tracking and command 
system. The tracking and command system in turn transmits 
its own imaging information as well as the craft’s surface- 
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based target information 206 to the satellite for integration 
into a database (MLIS) as previously described. 

In addition to collecting information about targets and 
responding to craft commands from the tracking and com- 
5 mand system, the craft may also use internal control logic to 
internally manage (208) collision avoidance. For example, 
the craft may include proximity sensors used to detect objects 
or other craft in its immediate vicinity. By using signals 
generated from the proximity sensors, the craft may avoid 
l o collisions with obj ects that the tracking and command system 
may not be able to detect. In a similar manner, the tracking 
and command system may generate (210) its own naviga- 
tional commands in order to travel to a new area for explora- 
tion or maintain its position within an area of exploration. The 
15 spaceborne tracking and command system may deploy sen- 
sors to determine atmospheric and ground conditions (e.g., 
within the canyon system of Valles Marineris) for further 
deployment of airborne and ground-based crafts. 

As depicted, the multi-agent autonomous system is a mul- 
20 tilayered and hierarchical system. For example, the surface- 
based crafts constitute one layer, the tracking and command 
system constitutes another layer, and the satellite constitutes 
yet another layer. Each layer or tier, in this embodiment, 
provides both information input from specific instrument 
25 suites and also includes computational elements. The exact 
distribution of the instrument suites, computational elements, 
and even the number of layers may be altered. For example, 
an extra airborne layer or subsurface layer may be added to 
command the tracking and command system to relocate. In 
30 addition, the computations performed by the tracking and 
command system may be performed by, for example, a sur- 
face-based craft or base station. Finally, the satellite may be 
used to track and command the surface-based craft without 
having an intervening airborne instrumented or processing 
35 element (e.g., on planetary bodies such as the Moon that lack 
an atmosphere). 

FIG. 3 is a block diagram of a surface-based agent or craft 
in accordance with an exemplary embodiment of the present 
invention. A craft 102 includes a controller 300 having pro- 
40 gramming instructions 301 for controlling the operation of 
the craft. The controller is coupled to a transceiver 302 and 
antenna 304 for receiving and transmitting signals 305 from a 
tracking and command system. The controller is further 
coupled to an instrument suite 204 (or “sensor suite”) used to 
45 analyze the craft’s environment. The sensor suite may 
include, for example, imaging sensors such as video cameras 
for capturing images of the environment for transmission to 
the tracking and command system. Any type of sensor or 
sampling mechanism (e.g., a robotic arm with a drill, a chemi- 
50 cal analysis unit, etc.) may also be included in the craft’s 
sensor suite for obtaining information and samples to be 
stored or transmitted to the command system. 

The instrument suite may further include proximity sen- 
sors used to sense objects or other craft in the immediate 
55 vicinity of the craft. The craft’s controller may be pro- 
grammed to use signals received from the proximity sensors 
to avoid collisions with obstacles or other craft. 

The controller is further coupled to a drive controller 306 
used to operate the craft’s drive mechanism 308. In one craft 
60 in accordance with an exemplary embodiment of the present 
invention, the surface-based craft includes a tread drive 
mechanism. In other crafts, the drive mechanism may include 
wheels, legs operable to move the craft, surface effect drives, 
appendages for climbing cliffs, etc. In addition, the surface- 
65 based craft may be operable on the surface of or within a body 
of water. Such a craft may be amphibious or be a boat, ship, or 
submarine. 
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In one multi -agent autonomous system in accordance with 
an exemplary embodiment of the present invention, an indi- 
vidually addressable Radio Controlled (R/C) robot unit is 
used as a surface-based craft. One such robot unit is supplied 
by Plantraco Ltd. of Saskatoon, Canada, and is known as a 
“Telecommander Desktop Sciencecraft” or “Desktop 
Rover”. 

Each Telecommander Desktop Sciencecraft system 
includes a sciencecraft unit and a Universal Serial Bus 
(USB) -controlled R/C commanding unit. A tracking and 
command system issues commands to the deployed science- 
craft via the USB-connected R/C control unit. Each science- 
craft operates on a unique R/C frequency. 

In addition, the Telecommander Desktop Sciencecraft con- 
tains an integrated onboard color video camera. When the 
sciencecraft arrives at a destination, it can relay in-situ images 
of the target back to the tracking and command system for 
science analysis. 

Although the Telecommander Desktop Sciencecraft sys- 
tem may be used effectively in some operational areas, one 
skilled in the art will understand that any craft suitable for the 
desired reconnaissance and exploration mission may be used, 
and modifications to be made to the crafts according to the 
desired mission will be readily understood to those skilled in 
the art. 

FIG. 4 is a block diagram of a craft tracking and command 
system in accordance with an exemplary embodiment of the 
present invention. A tracking and command system 100 
includes a controller 400 for controlling the operations of the 
tracking and command system. The controller is coupled to a 
satellite transceiver 402 for communicating with a satellite 
118. The controller is further coupled to a craft transceiver 
404 used to communicate with a surface-based craft 1 02. The 
controller is further coupled to an instrument suite interface 
406. The controller uses the instrument suite interface to 
control the operations of an instrument drive 408 coupled to 
an instrument suite 200. The instrument drive may be used to 
aim, focus, and adjust the magnification of imaging sensors 
such as optical cameras, or any other type of sensor. The 
instrument suite is electrically coupled to the instrument suite 
interface for use by the controller in collection of information 
used by the tracking and command system to track the sur- 
face-based craft and generate paths for the surface-based 
craft. 

If the tracking and command system is mounted on a plat- 
form that is capable of transporting the tracking and com- 
mand system between operational areas, the controller is 
further coupled to a platform drive interface 410. The plat- 
form drive interface is further coupled to a platform drive 
mechanism 412. 

FIG. 5 is a software module diagram of a multi-agent 
autonomous system in accordance with an exemplary 
embodiment of the present invention. The tracking and com- 
mand system includes a communications module 500 for 
receiving commands from a satellite or other external system. 
Once an initiate signal is received, the tracking and command 
system uses an overhead image capturing module 501 to 
capture an image of an operational area. The image 502 is 
transmitted to a reconnaissance craft position module 504. 
The reconnaissance craft position module uses the image to 
determine the location and heading 506 of a surface-based 
craft in the area of operation. The image is fiirther used by an 
imaging processing module 512 to identify any obstacles that 
may be in the area to be explored by generating a set of 
obstacle coordinates and outlines or edges 514. 

A processed image 516 from the image processing module 
is transmitted to a feature detection module 518. The feature 
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detection module uses the processed image to demark image 
features 520 that are transmitted to a reconnaissance and 
target identification module 522. The reconnaissance and 
target identification module identifies features of interest in 
5 the operational area. Those features of highest interest are 
identified as targets and a set of target positions 523 is gen- 
erated. 

Examples of suitable detection modules and reconnais- 
sance and target identification modules are discussed in, for 
10 example, Fink et. al, AGFA : {Airborne) Automated Geologic 
Field Analyzer , Symposium SS-56: “New results from the 
robotic exploration of Mars and Titan and their implications 
on planetary environmental conditions and cosmochemis- 
try”, Abstracts of the \ 5 th Annual V. M. Goldschmidt Confer- 
15 ence, Moscow, Id. Geochimica et Cosmochimica Acta , Vol- 
ume 69, Number 10S, A535 (2005), which is incorporated by 
reference in its entirety herein. 

A path planning module 508 receives the reconnaissance 
craft location information 506, the obstacle location and edge 
20 information 514, and target positions 523 . The path planning 
module uses this information to plan a path for the craft and 
generate a set of craft commands 524. The tracking and com- 
mand system then uses a craft communication module to 
transmit the craft commands to a craft. 

25 The craft communication module is also used to receive 
transmissions from a craft. The transmissions may include 
information collected by the craft using the craft ’ s own instru- 
mentation suite, such as a camera image 528. This informa- 
tion is provided to the path planning module along with the 
30 information taken from the tracking and command system. 
The path planning module may use the craft instrument suite 
information to further refine the craft commands to be sent to 
the craft. 

The software modules continuously process information 
35 received from the tracking and command system instrument 
suite and the craft instrument suite as indicated by feedback 
loop 526. This generates a constant stream of craft commands 
that are transmitted to the surface-based craft as they travel 
within the operational area. 

40 The path planning module forwards the craft’ s instrument 
suite information 530 to an in-situ measurement module 532. 
The in-situ measurement module analyzes the information 
received from the surface-based craft and forwards the result- 
ant measurements 533 to an intelligence reconnaissance out- 
45 put module 534. The intelligence reconnaissance output mod- 
ule transmits the craft information to external entities for 
integration into a previously described database 122 (MLIS) 
(of FIG. 16). 

FIG. 6 is a process flow diagram for a multi-agent autono- 
50 mous system in accordance with an exemplary embodiment 
of the present invention. The process flow diagram illustrates 
the processing sequence of the software modules of FIG. 5. A 
tracking and command system receives an exploration initia- 
tion signal 600 and iterates (602) the following sequence of 
55 operations. In a science and imaging process phase 604, the 
tracking and command system collects images about an 
operational area including surface-based craft deployed in the 
operational area. In a craft path determination phase (606) the 
tracking and command system determines a pathway to be 
60 followed by a craft in the operational area. In a craft command 
phase (608), the tracking and command system commands a 
craft 1 02 in such a way that the craft moves along a designated 
path between obstacles and towards a target. The process 
repeats iteratively 602 such that the craft follows a pathway to 
65 a target location. 

In slightly more detail, the science and imaging process 
phase fiirther includes receiving an image 609 of an opera- 
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tional area including images of any craft deployed in the 
operational area. The tracking and command system deter- 
mines (610) from the image the location and heading of any 
craft in the operational area. The tracking and command 
system also acquires (612) the image and processes (614) the 
image to determine (616) obstacles and targets within the 
operational area. 

During the craft path determination phase, the tracking and 
command system uses the obstacles, targets, and crafts’ cur- 
rent positions to determine (618) a navigation baseline for 
each craft deployed in the operational area. The tracking and 
command system then generates (620) a pathway or trajec- 
tory for each craft to follow so that the craft may avoid the 
identified obstacles and reach a target. 

FIG. la is a semi-schematic drawing of a craft imaged in an 
environment by a craft tracking and command system in 
accordance with an exemplary embodiment of the present 
invention. The image 700 includes an image taken of a craft 
702. The craft includes markings or other indicia that are 
visible to the tracking and command system’s instrument 
suite. The markings may be used by the tracking and com- 
mand system to determine a craft’s heading. The image fur- 
ther includes images of obstacles, such as obstacles 704a, 
7046, and 704c, that may impede the progress of the craft as 
the craft moves around within the imaged area. The image 
further includes images of targets, suchas 710a and710b, that 
the tracking and command system may determine are of 
interest. The tracking and command system will use the 
image to determine a path for the craft to take to reach the 
targets while avoiding the obstacles. 

FIG. lb is a semi- schematic drawing of a craft, targets, and 
obstacles identified in an environment by a craft tracking and 
command system in accordance with an exemplary embodi- 
ment of the present invention. The tracking and command 
system identifies the craft 702 in the image by extracting 
features from the image and analyzing the features. Once the 
tracking and command system has identified the craft, as 
exemplified by the box 712a, the tracking and command 
system can determine the craft position. In addition, the track- 
ing and command system uses the indicia on the craft to 
determine the heading of the craft. 

The tracking and command system also separates other 
features within the image into obstacles and targets. A target 
may be separated from an obstacle by considering a feature 
space including the object’s size, shape, albedo, surface 
irregularities, etc. Once an object has been identified as a 
target, as exemplified by box 7126 around target 710a, the 
tracking and command system can determine the target’s 
position. The tracking and command system continues pro- 
cessing features in the image to identify other targets, such as 
target 7106, as exemplified by triangle 712c. Other features 
identified by the tracking system, suchas features 704a, 7046, 
and 704c, are identified as obstacles to be avoided by the craft. 

FIG. 7c is a semi -schematic drawing of a planned craft path 
in accordance with an exemplary embodiment of the present 
invention. The craft is commanded by the tracking and com- 
mand system to travel through the imaged operational area 
through a sequence of moves. For example, the craft 702 may 
be commanded to rotate a specified number of degrees in 
order to adjust its heading so that the craft is pointed toward its 
next target 710a. The craft is then commanded to travel a 
certain distance along its path, thus defining a segment 7146 
of a path. The path segment avoids obstacles 704a and 7046 
and takes the craft to its first target. The path segment may 
also take the craft part of the way to its first target along a 
particular trajectory. The craft may then be commanded to 
move the rest of the way to its target along the same trajectory. 
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When the craft arrives at the first target, it proceeds to analyze 
the target, and transmits analysis data to the tracking and 
command system. The craft is then commanded to rotate and 
travel along path segment 714a to a second target 7106, while 
5 avoiding obstacle 704c. In this way, the craft is commanded to 
travel throughout an operational area, traveling from target to 
target without becoming obstructed by an obstacle. As the 
tracking and command system has information about a large 
area, it may intelligently command a craft through the large 
to area without placing the craft into an untenable position. 
Furthermore, the tracking and command system may com- 
mand a craft along an optimized trajectory through the large 
area. 

FIG. 8 is a semi-schematic drawing depicting an iterative 
15 path planning sequence in accordance with an exemplary 
embodiment of the present invention. A craft 702 may be 
commanded to pass through an area to target 7106. As the 
tracking and command system may take a sequence of images 
in order to command the craft, the tracking and command 
20 system may issue a sequence of craft commands adjusting the 
craft’s path through the environment in incremental steps. In 
this way, the multi -agent autonomous system may correct any 
errors that occur in the craft’s progress. For example, the 
tracking and command system may command the craft to 
25 travel along path segment 800a. The tracking and command 
system issues a rotation command and a move forward com- 
mand to the craft. As the craft moves forward, it may deviate 
from the desired path as indicated by segment 8006. In sub- 
sequent iterative steps, the tracking and command system 
30 takes images of the operational area and calculates additional 
segments for the path. For example, the tracking and com- 
mand system may command the craft to rotate and follow 
path segment 802a only to discover that the craft has traveled 
along path segment 8026. Upon each iteration, the tracking 
35 and command system may issue commands guiding the craft 
along successive segments, such as 800a, 802a, and 804a, 
each time correcting the path of the craft when the tracking 
and command system determines that the craft has actually 
traveled along other path segments, such as 8006, 8026, and 
40 8046. Thus, through successive craft commands, the tracking 
and command system guides the craft along successive path 
segments, resulting in the craft arriving at the desired target 
7106. 

Rather than moving multiple crafts in the operational area 
45 simultaneously, each craft can be commanded or moved 
sequentially, as shown in FIGS. YLa-Ylq and 13. A satellite 
orbiter 118 sends a command to an airborne command system 
100a to move to a desired operational area (FIG. 12a). The 
airborne command system 1 00a moves to the operational area 
50 according to the command and drops a plurality of crafts onto 
the surface of the operational area (FIG. 126). Crafts 702a, 
7026, 702c, and 70 2d are then deployed into the operational 
area (FIG. 12c). The satellite orbiter 118 then sends a com- 
mand to the airborne command system 100a to scout out 
55 particular areas of interest and determine desired destinations 
for the plurality of crafts 702a, 7026, 702c, and 102d (FIG. 
\2d-\2e). The airborne command system 100a determines a 
path segment 800a for the craft 702a to move toward the 
desired destination 710a, as discussed above, and sends this 
60 command to the first craft 702a. The first craft 702a then 
moves according to the command (FIG. 12/). 

The airborne command system 100a determines a path 
segment 1800a for a second craft 7026 to move toward its 
desired destination 1710a, and sends this command to the 
65 second craft 7026 (FIG. 12g) . In this embodiment, the desired 
destinations of the crafts 702a and 7026 are different, but it is 
also within the scope of the invention for the desired destina- 
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tions to be the same. The second craft 7026 then moves 
according to the command. As shown in FIG. 126, the path 
segment 1800a does not constitute the total distance to the 
desired destination 1710a. It is also within the scope of the 
invention, however, for the path segment 1800a to constitute 
the total distance to the desired destination 1710a. 

The airborne command system continues to command 
each of the remaining crafts 702c and 702 d to move along 
path segments toward their respective destinations. Each of 
the remaining crafts is then moved sequentially. The path 
segments may constitute the entire distance to the desired 
destination, or they may be a certain distance toward the 
desired destination along a certain path trajectory (FIGS. 
126-12/). 

After all of the crafts are moved, the crafts can transmit a 
location or “target reached” signal as well as gathered science 
data to the command system 1 00a or to the satellite 1 1 8, or the 
command system 100a and/or satellite 118 can image the 
operational area as described above to determine the location 
of the crafts (FIGS. 12/-12/). If each of the crafts have arrived 
at their desired destinations, they may proceed sensing infor- 
mation about the target and transmitting the information to 
the command system and/or to the satellite. The command 
system 100a and/or the satellite 118 may then determine a 
new set of targets or desired destinations for each of the crafts 
(FIG. 12m). 

If the location of the first craft is determined to be different 
than expected, for example the first craft traveled along path 
8006 instead of 800a, the airborne command system redeter- 
mines a path segment 802a from the first craft’s actual loca- 
tion toward the desired destination, as described in relation to 
FIG. 7c. The command system then sends the command to the 
first craft 702a to move along path segment 802a toward the 
desired destination 7106 (FIG. 12 n). 

The command system commands each of the remaining 
crafts 7026-702^ to move along path segments toward their 
respective targets, and the crafts are then moved sequentially 
according to the commands. This method greatly limits the 
possibility of collisions between the crafts and simplifies path 
planning. 

Characteristics of the operational area or objects within the 
operational area can be detected by any of the crafts, the 
command system, the satellite, or any other agent in commu- 
nication with the multi-agent autonomous system. In one 
embodiment, the characteristics are transmitted from a craft 
to the command system or the satellite and/or directly to 
another craft. The crafts may also function as a second, addi- 
tional layer of command systems to command movement of 
other crafts. 

The redetermination of the path segments may be triggered 
by detection of those characteristics, such as the actual loca- 
tion of the craft, as described above. Other spatial character- 
istics that may trigger the redetermination are, for example, a 
feature of the operational area, or a feature of an object in the 
operational area, such as an obstacle or another craft. The 
feature can be movement of the object, a difference between 
the object and the operational area, a composition of the 
object, a location of the object, etc. The detected characteris- 
tic may also be temporal, such as a certain amount of time 
passing or a specific, predetermined time. 

The redetermination of the path segments may also be 
triggered by detection of an anomaly such as a transient event 
or unique object sensed in the operational area. The craft, 
command system, or satellite, for example, can sense infor- 
mation about the operational area and compare it to a dataset 
of previously collected data, expected data, data from a dif- 
ferent operational area, or other portions of the sensed infor- 
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mation. If the data comparison results in an anomaly, for 
example, a certain deviation from the expected information, 
the surrounding environment, or previous readings, a new 
path segment can be determined to collect more information 
5 about the anomaly, tag its location, or maneuver around it. 

Once all of the intended targets have been hilly explored, 
the command system sends an “all done” signal to the satel- 
lite, which sends back a command for a new operational area 
to be explored (FIGS. 12a- 12/?). The process is then repeated 
10 until all operational areas have been explored (FIG. 12q). 

FIG. 9 is a process flow diagram of an image processing 
system in accordance with an exemplary embodiment of the 
present invention. A tracking and command system processes 
images from its instrument suite to determine a path for a 
1 5 craft. The tracking and command system does so by receiving 
an image and extracting information from the image in a 
sequence of passes, saving intermediate results in a tempo- 
rary datastore. In a first pass, the tracking and command 
system converts (900) an input file image 902 into an image 
20 file 903 including color information and an image file 904 
wherein the colors have been mapped to a grayscale. The 
tracking and command system then extracts (906) feature 
information 908 from the grayscale image file. The tracking 
and command system uses the feature information to identify 
25 (910) obstacles and targets and extract locations 912 of the 
obstacles and targets. The tracking and command system then 
uses the image file and the locations to generate (914) a mark 
feature file 916 of features that the tracking and command 
system may find to be interesting. 

30 The tracking and command system next uses the image file 

and the location file to generate (918) a color file 920 wherein 
the color of each object, such as obstacles or targets, (includ- 
ing unexpected characteristic s/anomalies), is indicated. The 
tracking and command system uses the image file and the 
35 location file to generate (922) an albedo file wherein the 
albedo of each object, such as obstacles or targets, is indi- 
cated. 

The image file, color file, and albedo file are used by the 
tracking and command system to generate (924) a target 
40 image file 932 and a target file 934 . The location file is finally 
used to generate (936) a navigation file 938 and a science 
target file 940 for use in determining a path for a craft. 

Algorithms for extracting features from an image, includ- 
ing extracting the position and heading of a man-made object 
45 in a natural environment, are well known in the art of robotics . 
Each algorithm has its own advantages and weaknesses. As 
such, multi-agent autonomous systems in accordance with 
exemplary embodiments of the present invention may include 
different feature extraction algorithms dependent on the 
50 needs of a researcher or explorer (or the needs of an industrial 
exploration, military mission, rescue mission, hazardous 
clean-up mission, etc.). 

In one multi -agent autonomous system in accordance with 
an exemplary embodiment of the present invention, opera- 
55 tional area analysis is performed by a suite of image process- 
ing programs entitled “Automated Geologic Field Analyzer” 
developed in part at the Jet Propulsion Laboratory of the 
California Institute of Technology, Pasadena, Calif., dis- 
cussed in Fink, et al, AGFA : ( Airborne ) Automated Geologic 
60 Field Analyzer , Symposium SS-56: “New results from the 
robotic exploration of Mars and Titan and their implications 
on planetary environmental conditions and cosmochemistry” 
in Abstracts of the \5 th Annual V. M. Goldschmidt Confer- 
ence, Moscow, Id. Geochimica et Cosmochimica Acta , Vol- 
65 ume 69, Number 1 OS, A535 (2005). In addition, craft tracking 
can be performed using a neural network using, for example, 
adaptive Radial Basis Functions (RBFs) for target recogni- 
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tion and tracking as described in “Real-time automatic target 
recognition using a compact 512x512 grayscale optical cor- 
relator, T. Chao, H. Zhou, G. F. Reyes, J. Hanan; Proceedings 
of SPIE Vol. #5106, the contents of which are hereby incor- 
porated by reference as if stated fully herein. 5 

FIG. 10 is a process flow diagram of a craft command 
process in accordance with an exemplary embodiment of the 
present invention. A tracking and command system uses a 
craft command process to generate paths for crafts deployed 
in an operational area. From the paths, specific craft com- 10 
mands are generated. To generate a path, a navigation base- 
line process 618 receives a navigation file 938 and science 
goal file 940 generated in the previously described image 
processing process of FIG. 9 . The navigation baseline process 
generates a landscape map 1000 and a navigation map 1002 . 15 
A pathway generation process 620 uses the landscape map, 
the navigation map, and the target file 934 to generate a 
pathway map 1004 . From the pathway map, individual craft 
commands are generated that are transmitted to a craft 102 in 
a craft commanding process 610 . 20 

Algorithms for determining paths for a robot in an accu- 
rately characterized environment are well known in the art of 
robotics. Each algorithm has its own advantages and weak- 
nesses. As such, multi -agent autonomous systems in accor- 
dance with exemplary embodiments of the present invention 25 
may include different path finding algorithms dependent on 
the needs of a researcher or explorer. In one multi-agent 
autonomous system in accordance with an exemplary 
embodiment of the present invention, path finding is per- 
formed using a line intersection method. Other algorithms 30 
may include weighted graph algorithms, the well-known A* 
method, etc. 

FIG. 11 is an architecture diagram of a data processing 
apparatus suitable for use as a craft tracking and command 
system controller in accordance with an exemplary embodi- 35 
ment of the present invention. The data processing apparatus 
400 includes a processor 1100 coupled to a main memory 
1102 via a system bus 1104 . The processor is also coupled to 
a data storage device 1106 via the system bus. The storage 
device includes programming instructions 1108 implement- 40 
ing the features of a tracking and command system as 
described above. In operation, the processor loads the pro- 
gramming instructions into the main memory and executes 
the programming instructions to implement the features of 
the tracking and command system. 45 

The data processing system may further include a plurality 
of communications device interfaces 1110 coupled to the 
processor via the system bus. A tracking and command sys- 
tem controller, hosted by the data processing system, uses the 
com m unications device interfaces to communicate with sur- 50 
face-bound craft, satellite, or other airborne agents/tracking 
and command systems as previously described. 

The data processing system may further include an instru- 
ment interface 1114 coupled to the processor via the system 
bus. A tracking and command system controller, hosted by 55 
the data processing system, uses the instrument interface to 
generate control signals for a tracking and imaging instru- 
ment suite as previously described. In addition, the instru- 
ment interface is used by the tracking and command system 
controller to receive instrument suite sensor signals such as 60 
images of the operational area. 

The data processing system may further include a platform 
drive interface 1116 coupled to the processor via the system 
bus. A tracking and command system controller, hosted by 
the data processing system, uses the platform drive interface 65 
to generate control signals for a platform supporting the 
tracking and command system. 
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Although this invention has been described in certain spe- 
cific embodiments, many additional modifications and varia- 
tions would be apparent to those skilled in the art. It is there- 
fore to be understood that this invention may be practiced 
otherwise than as specifically described. Thus, the present 
embodiments of the invention should be considered in all 
respects as illustrative and not restrictive, the scope of the 
invention to be determined by any claims supported by this 
application and the claims’ equivalents rather than the fore- 
going description. 

What is claimed is: 

1. A method of controlling a plurality of crafts in an opera- 
tional area, the method comprising: 

providing a command system; 

providing a first craft in the operational area and coupled to 
the command system; 

providing a second craft in the operational area and 
coupled to the command system; 
determining a first desired destination and a first trajectory 
to the first desired destination; 
sending a first command from the command system to the 
first craft to move a first distance along the first trajec- 
tory; 

moving the first craft according to the first command; 
sensing of the operational area by the first craft to obtain 
sensing information; 

transmitting the sensing information to the command sys- 
tem; 

determining a second desired destination and a second 
trajectory to the second desired destination; and 
sending a second command from the command system to 
the second craft to move a second distance along the 
second trajectory. 

2 . The method of claim 1 , wherein the second command is 
sent after sending the first command. 

3 . The method of claim 1 , wherein the first distance is 
shorter than a distance of the first trajectory to the first desired 
destination. 

4 . The method of claim 1 , wherein the second distance is 
shorter than a distance of the second trajectory to the second 
desired destination. 

5 . The method of claim 1 , wherein the first desired desti- 
nation is the same as the second desired destination. 

6. The method of claim 1, wherein the first desired desti- 
nation is different from the second desired destination. 

7 . The method of claim 1 , wherein the command system is 
in the operational area. 

8. The method of claim 1, wherein the command system is 
outside of the operational area. 

9 . The method of claim 1 , wherein the first craft is at least 
one of ground-based, subsurface-based, airborne, space- 
borne, or waterborne. 

10. The method of claim 1, further comprising: 
providing a third craft in the operational area and coupled 

to at least one of the command system, the first craft, or 
the second craft; 

determining a third desired destination and a third trajec- 
tory to the third desired destination; 
sending a third command from the at least one of the 
command system, the first craft, or the second craft to the 
third craft to move a third distance along the third tra- 
jectory; 

moving the third craft according to the third command. 

11 . The method of claim 10 , ftirther comprising determin- 
ing a third trajectory. 

12 . The method of claim 11 , wherein the third trajectory is 
the same as the first trajectory. 
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13 . The method of claim 11, wherein the third trajectory is 
different from the first trajectory. 

14. The method of claim 11, wherein the determining of the 
third trajectory is based on the determined location of the first 
craft, and the third trajectory is toward the first desired desti- 
nation. 

15. The method of claim 11, further comprising determin- 
ing a third desired destination, and wherein the third trajec- 
tory is a trajectory to the third desired destination. 

16. The method of claim 11, further comprising sending a 
fourth command from the command system to the first craft to 
move a fourth distance along a fourth trajectory. 

17. The method of claim 11, further comprising detecting a 
characteristic, wherein the determining of the third trajectory 
is triggered by the detection of the characteristic. 

18. The method of claim 17, wherein the detecting the 
characteristic is by at least one of the first craft, the second 
craft, or the command system. 

19. The method of claim 17, wherein the characteristic is 
temporal. 

20. The method of claim 17, wherein the characteristic is 
spatial. 

21. The method of claim 17, wherein the characteristic is a 
location of the first craft. 

22. The method of claim 17, wherein the characteristic is a 
feature of the operational area. 

23. The method of claim 17, wherein the characteristic is a 
feature of an object in the operational area. 

24. The method of claim 23, wherein the object is an 
obstacle. 

25. The method of claim 23, wherein the feature is move- 
ment of the object. 

26. The method of claim 23, wherein the feature is a dif- 
ference between the object and the operational area. 

27. The method of claim 23, wherein the feature is a com- 
position of the object. 

28. The method of claim 23, wherein the feature is a loca- 
tion of the object. 

29. The method of claim 11, further comprising: 

providing a first dataset of information; 

comparing the sensing information to the first dataset to 
detect an anomaly, 

wherein the determining of the third trajectory is triggered 
by detection of the anomaly. 

30. The method of claim 29, wherein the first dataset of 
information comprises information sensed from the opera- 
tional area at a previous time. 

31. The method of claim 29, wherein the first dataset of 
information comprises information sensed from a different 
operational area. 

32. The method of claim 29, wherein the first dataset of 
information comprises information expected to be sensed 
from the operational area. 


18 

33. The method of claim 29, wherein the anomaly is a 
difference between the first dataset and the sensing informa- 
tion. 

34. The method of claim 29, wherein further sensing of the 
5 operational area is performed by at least one of the second 

craft, the third craft, or the command system. 

35. The method of claim 1, further comprising moving the 
second craft according to the second command after moving 
the first craft according to the first command. 

10 36. The method of claim 35, further comprising determin- 

ing a location of the second craft after moving the second craft 
according to the second command. 

37. The method of claim 1 , further comprising determining 
a location of the first craft after moving the first craft accord- 

15 ing to the first command. 

38 . The method of claim 1 , further comprising determining 
a third trajectory for the first craft by the command system at 
least in part based on the sensing information. 

39. The method of claim 38, further comprising sending a 
third command to the first craft to move a third distance along 
the third trajectory. 

40. The method of claim 1, wherein the command system 
floats above the operational area. 

25 41. A method of controlling a plurality of crafts in an 

operational area, the method comprising: 
providing a command system; 

providing a first craft in the operational area and coupled to 
the command system; 

30 providing a second craft in the operational area and 
coupled to the command system; 
providing a third craft in the operational area and coupled 
to the first craft, the second craft, or both; 
determining a first desired destination and a first trajectory 
35 to the first desired destination; 

sending a first command from the command system to the 
first craft to move a first distance along the first trajec- 
tory; 

moving the first craft according to the first command; 
determining a second desired destination and a second 
trajectory to the second desired destination; 
sending a second command from the command system to 
the second craft to move a second distance along the 
45 second trajectory; 

determining a third desired destination and a third trajec- 
tory to the third desired destination; 
sending a third command from the first craft, the second 
craft, or both to the third craft to move a third distance 
50 along the third trajectory; 

moving the third craft according to the third command. 





